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STORY PROBLEM SOLVER: 
A schema-based system of instruction 



This report describes a computer-based insiiuciional system, the Story Problem Solver 
(SPS). SPS provides students with instruction about the semantic structure of story problems. It 
was developed !o test a specific schema theory of knowledge organization in long-term memory 
(Marshall, 1988a; 1988h). For this reason SPS depends explicitly upon a theory of the relationship 
between the form of instruction and the memory stiuctures that develop as a result. 

In this document we describe the schema theory underlying SPS, the design of SPS with 
respect to the theory, and the system's operational features. The domain of aiithmetic story 
problems has been described in detail elsewhere (Marshall, 1987; Marshall, Pribe, & Smith, 1987) 
and is only briefly reviewed. The report concludes with a short description of ongoing extensions 
to the basic instructional program. 

THEORETICAL STRUCTURE 
Schema Theory 

SPS is designed to develop a student's awareness and undei'standing of the basic relations 
found in arithmetic story problems. It piovides instruction which will facilitate the use and 
organization of information in long-term memory. The instructional design derives from the theory 
of schema acquisition and storage described in Marshall (1988a). According to the theory there 
are four components or types of knowledge involved in the development of a schema: feature 
recognition, constraint mapping, planning/goal setting, and implementation. This architecture derives 
from that described in Marshall et al. (1987). 

Under the theory each component develops in long-term memoiy as a network of nodes, 
representing bits of information, and links between nodes, representing memory connections among 
them. The presence of a particular node in a network indicates that the information it represents 
has been learned and can be retrieved fiom memoiy. The links to othei nodes piovide access to 
the information stored in them. A node that is isolated from others is of little use because it is 
accessed only on rare occasions, but a node linked to many others is accessed and used frequently. 
Thus, a critical element of learning is the connection of any new information to previously learned 
information. 

The networks comprising schemas intertwine on several levels. First, within a single schema, 
there are connections fiom nodes of one component to other nodes in that component and also 
to nodes in other components. Second, the components of a schema are themselves linked, so that 
access to the information associated with one component will allow access to infoimation associated 
with the other components Finally, schemas are linked to each othei within domains. At an 
abstract level of thinking about tne whole domain one should have ready access from one schema 
to another. 

The Domain 

Marshall (I98S) found that arithmetic story pioblems can be categorized by five distinct 
profiles: Change, Group, Compare, Restate, and Vary.* These profiles describe the semantic 
relations found in stoi^ problems and together comprise the common domain of story problems. 
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Each piofile lepresenis a paiticulai relaiion thai ikcuis in sioiy foim. and the story line is woven 
around the relation. Ordinarily one or moie of the features that define the relation is unknown. 

The advantages of categorizing the domain by semantic relation aie (1) only a limited numliei 
are needed, (2) the relations are simple situations, deriving from individuals' expeiiences in daily 
life and easily understood even by young children, and (3) they may b-^ combined to form complex 
problems reflective of situations that occui in reality. Thus, they may be used as a basis of 
instruction for learners of all ages. 

The five semantic profiles have been desciibed in detail elsewhere an J will not be discussed 
at length here (c.f. Marshall et al., 1987). Table I contains examples of profiles in smiple f 
situations, in simple problems, and in complex problems. These aie typical of the situations and 
problems encountered by students who use SPS. 

In developing the instructional programs described here we found it necessary to reevaluate * 
the Compare profile and the way its aaompanying semantic relation is used in a story problem. 
The Compare profile describes the semantic relation in which two entities are examined foi the 
purpose of deciding their relative size. As such, it requires no arithmetic computation. It does, 
however, require sufficient number sense to lecognize when one number is largei oi smaller than 
another. In its simplest form, the Compare relation seems almost trivial: 

(1) Here are two numbers, 25 and 29. Which is larger? 

The complexity of the profile and the semantic component come into play when the student must 
interpret the descriptive statements linking the two numbers. That is, when the i elation is 
expressed as faster, higher, cheaper, deeper, longer, and so on, should the student search foi the 
larger or smaller number? Moreover, what are legitimate comparisons? Can any two quantities 
be compared or are there constraints requiring them to lie of similai type (e.g., inches with inches 
rather than inches with yards)? The semantic requirements of Compare are sophisticated and 
involve an understanding of the situation represented in the problem. 

Our original definition of Compaie (and othere' definitions as well, e.g. Riley & Greeno, 
1988; Willis 6l Fuson, 1988) asked a different question of the Compare situation. For example, 
under our previous conception the following was labeled a Compare item: 

(2) Joe walked a mile in 13 minutes. His friend Fred walked a mile in 15 minutes. 
How much faster did Joe walk than Fred? 

In actuality, this is not a true Compare relation in which the problem solvei is asked to make a 
comparison because the comparison has already taken place - it is stated in the problem that Joe 
walked faster than Fred. The solver does not have to decide who was faster oi whether more 
minutes means faster or slower walking. Problem (2) is a Restate relation. It asks the student 
to express in a different way the information alieady given in the problem. 
A true Compare relation would have the following form: 

(3) Joe walked a mile in 13 minutes. His friend Fred walked a mile in 15 minutes. 
Who was the faster walker? 

This lattei problem reflects the way that the Compare relation is taught and used in SPS. The 
solver needs to decide what to compare and whethei to retrieve the larger or the smaller amount. 
Under our new formulation, familiar problems ftom textbooks such as 

(4) Sue has 30 pencils, and Joan has 20. Who has more and how much more? 

are viewed as having two different semantic relations, corresponding to the two distinct questions 
posed in the problem. First, the solver is asked to determine who has the larger amount 
(Compare), and, second, ihe solver is asked to compute the value of the difference (Restate). 

2 
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Table 1 



Examples of Situations, Simple Problems and Multi-Step Problems Used in SPS 

A. Situations 

CHANGE: Samaniha was running a lemonade siand one day in ihe summer. She siaited out 
ihe day wiih iweniy-five glasses of lemonade. When she closed her siand ai ihe end 
of Ihe day she had four glasses left. Samaniha sold iweniy-one glasses of lemonade. 

GROUP: Mr. Green grows oranges, grapefruits, and avocados. If he has 3000 fiuii irees in all 
and there are 2000 orange and grapefruit trees, then Mr. Green has 1000 avocado trees. 

COMPARE: On a recent expedition two membeis of the hiking club climbed 5000 feel on one d»iy 
and 6000 feet on the second day. They climl>ed further on the second day. 

RESTATE: Mary budgets her money carefully. She allows herself to spend 15 peicent of her 

weekly income on fun things like going to the movies or stopping foi ice cream. Last 
week she earned $120, so she had $18 for fun things. 

VARY: Mr. Borg's car can travel 20 miles on each gallon of gas that it uses. Since he knew 
that he would be driving 300 miles over the weekend, he figured ihu he would have 
to buy 15 gallons of gas for his weekend driving. 

fi. Simple Problems 

CHANGE: Janine had 173 malchbook covers in her collection. Her aunt sent some more to her. 
She now has 241 matchbook covers. How many did her aunt send to her? 

GROUP: Last week the Martin family took their used bottles, cans, and newspapers to the River 

City Recycling Center. They found that they had accumulated in one year 25 pounds 

of bottles, 12 pounds of cans, and 50 pounds of newspapers. How many pounces of 
recyclable materials did they have? 

COMPARE: Anna has two jobs. Last week she eained $152 as a lab assistant in the Chemistry 
Lab and $93 as a cashier in the University Book Store. Which job paid better? 

RESTATE: Bill and Cddie both planted tomatoes this year. Bill harvested twice as many tomatoes 
as Eddie did. If Bill picked 64 tomatoes, how many tomatoes did Eddie pick? 

VARY: In the college football stadium there aie 28 sections of seals. The stadium has a total of 
2128 seats. If each section holds the .same number of seats, how many seals are in each one? 

C. Multi-Step Problems 

1. Joe won $100 in the state loiteiy. He spent some of it on toys for his children. He bought 
a doll for Sue that cost $25 and a stuffed bear for Ellen that cost $35. How much money 
did he have left over after he bought the toys? 

2. The electric company charges $.18 for every 3 kilowatt houi-s of power used. For the month 
of August Terry was billed for 251 kilowatt hours of electricity. During the same month his 
natural gas bill was $9.45. Which was higher for the month of August, his electric bill or his 
gas bill? 



INSTRUCTIONAL DESIGN 



SPS focuses on ihej^ five profiles. Ai ihe end or insiruciion a sludeni should be able lo: 

* Recognize Ihe profilc(s) in a slory problem. 

* Check thai a problem has the required elements of the chosen profile(s). 

* Design a solution strategy using profile information. 

* Select the correct arithmetic operation(s). 

SPS guides ihe siudeni's knowledge developmeni and organization according lo ihe schema theory 
described above. Our inieniic : is for ihe siudeni lo develop a separaie schema, consisting of all four 
components, for each of the five profiles. 

SPS is designed for use by young adults under the assumption that this population shares a body 
of common knowledge and interests. The subject matter of examples and problems reflects this 
assumption. Much of the instruction about the semantic profiles is direct. Because the targeted 
population is adult, it is possible to present extended instruction that would overtax the attention and 
working memory constraints of young children. 

SPS does not exptct students to form appropriate schemas by trial and ^»rior. Its useis are not 
being introduced to stor, problems for the first time. They have had a great deal of experience with 
them and typically h^ve developed poor or incomplete strategies for solving them (evidenced by a lack 
of success on performa> ce measures). SPS explains directly how and why its organization of knowledge 
is beneficial. It peir.;s out the advantage of using the profiles to understand and solve the problems. 

SPS prefaces its instruction by drawing an analogy between understanding a story problem and 
understanding the real world situation of going to a restaurant. The purpose of the restaurant example 
and the discussion about how individuals recognize and use knowledge about restaurants is to alert 
students to the need for many kinds of knowledge and for many links among them. The example 
demonstrates how various features of the situation are used by an individual to interpret the particular 
instance (e.g., what makes it a restaurant and not a theatre) and to guide the individual in that setting 
(e.g., how to order from a menu, how to pay the bill). SPS explains that understanding and interpreting 
the situation in a story problem can work in the same v^ay. Impoaant features need to be recognized 
and evaluated before an arithmetic operation can be selected. 

SPS addresses each of the four components of schema knowledge for every semantic profile. The 
student is encouraged to bui!d a cohesive memory structure to link together all of the information that 
is appropriate to the profile. To do this, SPS isolates the components and focuses upon the elements 
of each one. h also gives the student experience i . linking the components and in using two or more 
of them in answering questions. SPS does this in pan by example and in part by asking questions 
relating lo components and linkages. 

For each component of a schema - feature recognition, constraint mapping, goal setting, and 
implementation - SPS uses the principles guiding its instruciion in specific ways. These adaptations are 
described in the following sections. 



Feature Recognition 

Instruction 

The feature recognition component of a schema contains the information needed to recognize that 
the schema fits the problem at hand. SPS's discussion of featuie recognition helps the student formulate 
the generic case of which any problem is a special instance. The goal of feature recognition instruction 
is to provide a verbal label, a general description, and a simple pictorial representation for each of the 
five profiles. Instruction begins by using simple examples of each profile. We found in our pilot studies 
thra students were better able to discriminate among the profiles when the initial instruction about each 
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one was brief and when all five were discussed together. This contrasted with ability to disciiminate the 
profiles having had a sequential, detailed description of each one (see Appendix A). Therefore. SPS 
begins the instruction with an overview and general discussion of all five schemas and how they diffei 
from each other. 

SPS introduces the profiles within the common theme of a Hawaiian vacation. The situations in 
which the profiles are found describe activities such as buying clothes, st '-ng. and fishing. As noted 
above, we selected stories that should be of interest to our young adult students. 

The SPS system uses situations instead oi problems when introducing the five profiles. Situations 
% are defined as complete stories with no missing information; problems have one or more unknowns. We 

focused on complete situations for two reasons. The first is logical consistency. Situations contain all 
parts of the profile and therefore help students understand each part in relation to the whole. Feature 
* recognition involves all parts of the situation, but any specific problem leaves some parts out. That^s 

what makes it a problem. To teach feature recognition, the whole situation is appropriate. 

The second reason for using situations is the nature of the subject population. Most students 
appear to have strongly ingrained and often erroneous problem-solving strategies, and they '.end to begin 
using them as soon as a problem is presented, otten without comprehending the entire problem. This 
tendency interferes with the goals of SPS. SPS urges the student to understand the structure of the 
problem before attempting computations. If there is no problem and no unknowns, there is no 
computation to be made, and the student's attention can be directed to the profile structure. 

SPS equips the student with specific clues for identifying each semantic profile. For example, the 
student learns that in the Change situation there are three different amounts - the beginning amount, 
the amount of change, and the resulting amount - and that the change occui-s ovei time. Other clues 
about Change are introduced in such a way that the student should easily associate them with earlier 
ones. In this way SPS directs the 'earning of the student by presenting information that can be 
reasonably linked to what the student already knows. 

In teaching feature recognition SPS tries to rearrange the knowledge that students aheady have 
about semantic relations and story problems and to encouiage the students through instruction, example, 
and practice to form specific memory associations (links). We do not have to explain to students - even 
very young ones - what it means to change something. We do need to help them develop the skills 
to perceive when a story problem describes the Change relation. The full set of clues for a profile leads 
the student to a general description of the profile. 

In addition to verbal clues, a simple diagram is used to represent each profile and its various 
parts. We refer to the diagram as the profik icon because it serves the same function that an icon 
serves on computer screens. The icon is a visual lepresentation intended to call to mind several different 
pieces of information. Merely seeing the icon on the screen serves to remind the student of the broadei 
entity it represents. Similarly, many trademarks and logos function to remind the viewer of a broad set 
of information that is associated with them (e.g.. the CBS "eye" or the Apple logo). These visual 
representations appear to be easily learned and retrieved. 

A growing body of research suggests that visual aids are very powerful learning tools (e.g.. Larkin 
& Simon. 1988; Holmes. 1987). We use them as such. It is intended that students associate the features 
of a profile with the ajrpropriate diagram. The icons also serve a second function in constraint mapping 
as described below. 

Evalmiion 

Feature recognition is assessed in two ways. One way is to determine whethei or not the student 
can correctly identify a situation b> its generic name. The evaluation task piesents the student with 
several story situations, one at a time. Below the story is a menu of the five profile names. The 
student's task is to select the single profile that is lepresented in the story. Thus, the task assesses Ixjth 
whether the student can identify the relevant features in the situation and also whether these features 
have been associated with the appropriate profile in the student's memory. 

The student's responses on this task, as on all SPS tasks, are made with the mouse. The student 
selects the profile and buttons the menu choice. An illustration of the task is given in Figure I. 
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Figure 1 

A Feature Recognition Task: Verbal Components 



(The Btud«nt ■•l«ctB • 
rmmponmm from • mmnu of 
Bltu«tlon naMB,) 



INSTRUCTIONS. ^••4 th« »tery f\o» Otcida v^hich of tha 
fivi ftituitiont bitt dauribat tha ttory. Whan /ou h«va 
rfiaila your <hei(a. portion tha arrow on top of tha ona you 
hava ftolactad end click tha mou»a button onca 



Two radio stations were competing for 
listeners by giving away fock concert tickets. 
In the" last week of August KODD gave away 
50 tickets. At the same time KCUE gave away 
1 5 fewer tickets. That means that KCuE gave 
away 35 tickets 



Change 

GroMp 

Compare 

Vary 

ResUte 



Figure 2 

A Feature Recognition Task: 



Visual Components 
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Sam bought one notebook for every three text 
books that he purchased If he bought four notebooks 
Sjm must have purchased twelve text books 
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A second mechod of evalnalion assesses the sludenl's ability lo associate a siiuaiion with its visual 
icon (diagram). The siudeni is presented with a problem and the five icons and is asked to select the 
one that represents the problem, No verbal labels are used in this exercise The task serves to assess 
whether the student associates individual icons with appropiiate sets of features that identify the pioHles 
An example is given in Figuie 2. 

Constraini Mapping 

Instruction 

Thf* goal of constraini mapping instruction is to develop :>ystemailc methods of testing whelhei 
01 not hypothesized features are present. This component of schema knowledge maps the elements of 
the current problem to the known features of the selected profile. Foi instance, by using feature 
recognition knowledge the student might suspect that the piofile describing a problem is the Change 
profile. This information alone is insufficient for problem solving. The student needs to ascertain that 
enough of the features that characterize a Change profile are present in the current problem to allow 
solution, in the case that the ftatuie recognition was incorrect, the student will also find that out when 
important elements of the problem do not map into the Change profile. 

it is useful to think of the constraint-mapping knowledge in a schema as the means by which 
the student constructs a woiking mental model of the problem being solved. The student leads a 
problem, calls upon feature recognition knowledge to suggest the appropriate profile structure, and then 
builds the model of the problem by testing whether the necessary pieces are present. When the student 
is beginning instiuclion, SPS displays the diagiammatic representation of the profile and visually places 
various parts of the problem into the diagram. As students become more expert in solving prolilems, 
SPS anticipates that they will do the matching process mentally. SPS focuses its instruction on linking 
parts of the story problem to the essential elements of each profile. To illustiate the instruction, we 
present here a discussion of the Change piofile Instruction foi the lemaining piofiles is similar. 

To develop the student's understanding of the Change profile, SFS presents a three-part figuie 
designating beginning amount, amount of change, and lesulting amount. Using a simple situation (with 
no unknowns) SPS leads the student through the diagram, placing the relevant numerical quantities inside 
the diagram and explaining why and how these quantities join together to form a Change i elation. 
Several examples of the how one maps a Change situation follow the explanation. 

After a siudent has had the opportunity to practice mapping situations into the Change diagram 
(the task itself is described below in Evaluation) SPS introduces problems in which one of the parts of 
the figure has no corresponding numerical value given in the story. This instruction begins with a simple 
situation, mapped into the tnree parts of the figure. SPS asks the student to consider what the situation 
would look like if one of these tbree parts were unknown. The diagram changes on tne screen so that 
the unknown pan contains a question mark. The story problem is reworded to contain a question alxiut 
the unknown. The diagram then changes again so that a different part contains !he question mark The 
problem changes as well and the question is diffeient. in this way SPS gives explicit instruction al>oui 
the question asked in the problem and the location of the unknown in tht* diagram. SPS takes the 
student through the allowable set of unknowns and coiresponding questions for each piofile. The seiies 
of questions asked about a particular Change situation is illustrated in Figuie 3. 

Pievious studies with sixth-giade students, with the pilot-study students, and with university lieshmen 
indicate that there are two areas of confusion that instruction should address (c.f., Marshall 1987; this 
report. Appendix A). FiiM, students tend to confuse Change and Group problems, especially when the 
arithnietic opeiallon of addition is required. Second, students tend to confuse Restate with Conipaie, 
again in the presence of addition and subtraction. Consequently, SPS introduces the Change constiaints 
and diagram first, going through the complete instruction, and then does the same with the Group 
constraints and diagram. When Ixjth have been fully covered, a special exeicise calls for the student to 
discriminate between the two profiles (by choosing the appropriate icon fiom a menu containing Ixiih 
of them) and to make the constraint mapping once the correct diagram «s selected. SPS moves on to 
instruction about Compaie and then separately to instruction about Restate As with Change and Group, 



when both Compare am! Resiaie have been covered, ihc student is asked to demonstrate ability to 
discriminate between the two and then to map parts of ?he problem into the appropriate diagiam. A 
discussion of the Vary profile concludes the constraini-niapping instruction. 

Evaluation 

Evaluation is in two parts: constiaint mapping per se and the relation of consliamt mapping 
and feature recognition. SPS uses two types of tasks to evaluate students' constraint-mapping knowledge. 
In the first SPS gives le student a set of five situations. Each of the situations is best described by 
a single profile. The task for the student is to match tach of the five situations with the name of the 
appropriate profile. This task includes and extends feature lecoijnition knowledge because it requires the 
student to identify a generic profile for the a situation and also requires confirmation that the profile 
does not wore accurately describe another situation. The student must considei each profile with each 
situation, deciding when the elements of a situation sufficiently match the structure of a profile. This task 
forces the student to compare the five profiles and the five situations with each othei. 

In the second evaluation task used to assess constraint-mapping knowledge. SPS asks the student to 
u?** constraint-mapping knowledge to position the relevant oarls of a story into a given diagram. The 
situation (or problem) and the correct blank diagram are presented simultaneously. The student noves 
the mouse cursor to the part of the situation that he or she intends to place in the diagram. When 
the student clicks the left mouse button, the student's selected text is printed inversely oi> the screen (i.e.. 
light on dark instead of dark on light). A dotted rectangle having the same size and sh?pe as the 
selected text appears on the screen, connected to the cursor. Now moving the cursoi will move the 
rectangle. The student moves the cursor and the attached rectangle, this time to the place in the 
diagram in which the text is to be positioned. Another click of the mouse button drops the text into 
the diagram.^ 

SPS simplifies these tasks for the student as much as possible In the constraint-mapping task 
It does not force the student to move parts of the story word by woid. That would be tedious and 
unnecessary. In most instances the student needed an entire phrase (e.g.. for the relation "twice as much 
as") rather than a single word or number. Consequently, when the situations and pioblems wt-ic initially 
entered into SPS. certain phrases were identified as chunks. Some of these chunks are r.ece^saiy parts 
of the problem solution (e.g.. the number and its identifier, as in 25 cookies). Others weie not necessary 
but typically appear together (e.g.. names such as Mr. Harris). Because a student could select .my part 
of a problem, we chunked all reasonable elements in a problem, whether or not they were requiied foi 
solution. When the student buttons in any part of a chunk, the entire set of words and numbers that 
make up the chunk are changed to inverted print. The individual elements cannot be moved by 
themselves. 

During this task the student has considerable flexibility. If the student desires to modify a previous 
response, it can be done simply by buttoning on the selected text, moving the cursor (and attached 
rectangle) out of the diagram, and buttoning again The student then returns to the problem, selects 
another part, and drags it into position. Like all exercises in SPS. this one is under student contiol 
SPS will not continue with problem presentation or with additional instruction until cued. For the 
mapping exercises, the student indicates that the diagram is filled and ready for SPS to check by 
selecting "OKAY" from a control menu printed at the bottom of the screen. At that point SPS 
evaluates the response and gives ft-xJback. If the student has made correct selections, the feedback is 
positive and SPS asks the student to indicate readiness for another exercise. If the student has erred. 
SPS informs the student of a mistake and gives the student a second change to map. If the student 
is incorrect a second time. SPS displays both the student's choices and the correct responses. Again, the 
student indicates when to continue by making a selection from the control menu. 
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Figure 3 

The Multiple Questions of Change 
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Figure 4 
A. Feature Recognition 



Durino a Monopolv game John had 3 houses jnri 
2 hottis John had 5 buildings on th« board 



(Th«» student first BttlttCtB 
th« approprlat* dlagrM 
f rom a menu . ) 



B. Constraint Mapping 



GoMi YouAdthwntHcorrKtty M«v«th« trrow la GOON 
•iW didi Kit m«uM bult«n wh«n youVt rMdy to go on 



During a Monopoly gam* John had 3 housas and 
2hotals John had 5 buildings on tha board 



(The selected diagram la 
enlarged, and the atudent 
maps the elements of the 
problem Into the diagram.) 
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The task which assesses the link between feature lecognition and constiaint mapping elicits two 
responses from the student, a discrimination among types of profiles and a mapping from the piobl^m 
to the profile. In the task students are presented with a mixed set of problems and situations. Each 
problem or situation is displayed with a menu of icons. The student's first response is to select the 
appropriate icon (a feature-recognition test). If the student makes the correct choice. SPS gives 
appropriate feedback and replaces the icon menu with the profile diagram which is an enlarged version 
of the selected icon. The student's second response is to map the problem into the diagram (a 
constraint-mapping evaluation). If the initial selection from the icon mciiu is incoirect, SPS provides 

% feedback about the choice and then displays the coirect enlarged diagram. 

SPS has three versions of this task. One of the versions follows instruction about Change and 
Group, and offers a choice only of these two profiles. A second, similar version follows instruction 

* about Compare and Restate and allows choice of these two. The third version follows instruction and 

practice with the Vary profile. In the last one they choose from all five profiles. Figure 4 illustrates 
one of the two-choice evaluation items. 

Planning/Goal'Setting 

Instruction 

Planning is quite simple in problems involving only one profile (i.e., one-step problems). SPS 
does not teach planning at this level. It deals with planning in problems involving two or more profiles 
(i.e., multi-step problems). To solve a multi-step problem the student must recognize the different 
profiles in the story and order them in such a way that the correct solution can be obtained. This 
entails recognizing the overall profile of the situation and determining how the subsequent profile or 
profiles are subordinated to it. 

SPS's instruction on planning has three pans. Part one is recognizing which profiles are primarv 
and which are secondary. Paa two teaches mapping what is known about the problem into the overai. 
or primary proflle. Part thret develops links between components of two or more profiles. All three 
emphases are important in developing a plan. Ideally, a student should ask himself or herself a sequence 
of questions about them such as the following: 

PROBLEM: Sarah had $1575 in her checking account at the end of March. 
She deposited a payroll check of $870, a gift from her parents for $200, 
and a refund check from !RS for $315. How mtich was in her accomt after 
she made the deposit? 

O: Do I know the overall profile? {feamre recognition) 
A: Yes, it's a Change. 

O*. Can I solve it yet? {constraintsi 
A: No, there are two missing paits. 

O: Is there a second profile? {feature recognition) 
A: Yes, it's a Group. 

O: Can I solve this one yet? iconstraints) 

A: Yes, it has three subgroups and I know all of them. 

O: Will the solution help me solve the first one? {goal- setting) 
A Yes, the Group result is the amount of change required in the 
Change problem. 
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O: What will my goals look like? 

A: The top goal is Change followed by Group. 

O: How shall I proceed io solve the problem? 
A: Take the lower goal (Group) first. Solve for it. 
Then take the next goal (Change) and solve for it. 

In teaching students to recognize primary and secondai'y profiles SPS stresses 'he difference between « 
top-down and bottom-up problem solving. It advocates a top-down strategy for planning and a bottom^ 
up strategy for carrying out computations. The relationship between these two strategies is made explicit 
through one of SPS's extended examples.^ The example centers on going to medical school. SPS * 
develops a plan that outlines the requirements for getting accepted, such as having a satisfactory CPA, 
having letters of recommendation, and so on. The plan is developed graphically on the screen, with the 
goal (going to mtdxaA school) posuioned at the top center and with subgoals branching below it. These 
subgoals are themselves developed further by outlining whdi each entails (such as scoring well on tests, 
going to class, etc. for having a satisfactory CPA). When complete, the full plan has the goal at the 
top, and it extends downward tlnougn subgoals to their constituent parts at the bottom. 

SPS then discusses how th^ goal might be achieved and points out the need to carry out all the 
steps at the bottom oi the plan in order to move up to the next level of subgoals. The plan 
developinent has arrows flowing from the ovtiall goal down to the subgoals. The plan execution reverses 
the arrows: They begin at the lowest part of the figuie and point up to the next subgoal. 

SPS draws an analogy between the medical school scenario and a multi-step problem, showing the 
student that the identity of the primary profile dictates the overall goal. At each step in solving a 
problem the student should evaluate whether the overall goal has been reached or whether the pursuit 
of a subgoal is needed. Subgoals correspond to secondary profiles embedded in the problem. Thus, SPS 
encourages the student to develop a system for representing the story problem abstractly in terms of its 
constituent profiles and to use that representation as a plan for problem solving. Further SPS 

instruction on planning centers on knowledge about semantic profiles. SPS frequently refers to the icons 
of feature recognition and the diagrams introduced in constraint mapping. For simple one-step problems, 
all but one of the parts of a profJe diagram can be filled directly with information given in the problem 
The single unknown corresponds to the question postd in the problem. Multi-step problems have more 
than one unknown in the overall profile. One of these corresponds to the question posed in the 
problem, just as it does in a one step problem. The unknown associated with the stated question 
represents the primary goal, and the overall profile is the primary profile. The other unknown quantities, 
while not answering the primary question, must nevertheless be found before the problem can be solved. 
SPS calls these secondary problems. - ch -econdary problem is solved by recognizing the semantic profile 
and using information from the asv^Cit J vr*>ema. These associated profiles are called secor:dary profiles. 
SPS uses only two-step problem*; if p tiuci on. ^nd, consequently, it focuses on a primary profile and 
a single secondary one. 

As part of its instruction ^ ta^. simple one-step problems into their respective profile diagrams 
by placing the numerical quanti' i. ^ the parts of the diagrams. The mapping at the multi-step level 
is more complex. To help studeni^ understand what is known or already given in a problem, SPS makes 
an abstract mapping into ;he overall profile diagram, h uses the terms Given for information that is 
explicitly stated in the p;oblem, PariiAl Answer for information that can be derived immediately from the 
Given information, and Final Answer for the value of the primary unknown. Final Answer will require 
having the solution for Partial Answer. This language promotes the maintenance of an abstract mental 
model of the entire problem. The advantage of the abstract model is that it is easier to maintain in 
short-term memory when the student begins solving the problem. As the student attempts to solve the 



^ As Hilh ihc oihcr Lxlcnilcd cwnipici in SPS. ihb one ^a* developed lo be of pariiinlir mitrcM lo our adtill popuKitioii h 
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Figure S 
A Multi Step Plan in SPS 
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Figure 6 

Exercise in Recognizing the Primary 
and Secondary Profiles 



INSTRUCTIONS RMd th« probUm Mo^ •nd look for th« ov«r«n 
iiiu«tion in th« probl«m«nd th« •nib«dd«d ft«cend«ry tituttion Firit. 
movi th« crrOM to th« n§m* of th« ov«r«U tituttion 
(in th« box marked OVERALL) tnd dick th« moutt button Ncat. mov« 
th« arrow .0 th« boH m«rk«d SECONDARV tnd ciick on th« iituition th«t 
II th« Mcond«ry or embedded on«. 



(Th« probiM as 
pr«B«ntttd th« 

BtiKtoltt.) 



Kartn and Cindy had a contest to sm who could lose 
the most weight in one month Karen lost a total of 10 
pounds Cindy went from a weight of 160 pounds to 
125 pounds Who won the contest'' 



OVERALL 



Change 

Group 

Compare 

Vary 

Restate 



SECONDARY 

Change 
Group 
Compare 
Vary 
Restate 



Tli« fiMin utuction in thit problem tt • COMPARE Notic* that you ar* 
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K«ron lott With th« •mount of wo<ght Cindy lost Now look at tht 
Mconncry iitu«tien. Wh«t i» it^ 



Keren end Cindy had acontest to see who could lose 
the most weight m one month Karen lost a total of 10 
pounds, Cindy went from a weight of 160 pounds tc 
125pounds Who won the contest? 
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Change 

Compare 

Vary 

Restate 



SECONDARY 

Change 
Group 
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Vary 
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(The student reeponde to the first 
question by selecilno an Item Vrom the 
OVERALL menu and racalvee feedback.) 
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Karen and Cindy had « contest to see who could lose 
the most weight in one month Keren lost a total of 10 
pounds Cindy went from a weight of 160 pounds to 
125 pounds Who won the contest 
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(The student responds to the sicond 
question by seUctIng an item from the 
SECONDARY menu and rocelves fssdback.) 
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Figure 7 



Exercise in Abstract Mapping 
of a Multi-Step Problem 
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J«*rry answered ten more problems correctly on the math test 
than Phil did Jerry gave correct answers to 80 percent of the 50 
items. How many Items did Philanswercorrectly? 
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Tha final answwar for thii problam ii tha numbar of corract itams that Fhil ansvwarad. 
Sinca you know that Jarry aniwwarod 10 mora than Phil, you first naad to know how 
many itamt Jarry answarad corractly. Jarry'i amount is tha partial answar. 


whan you ara raady to go, dick in tha GO ON boM. 






Jerry answered ten more problems correctly on the math test 
than Phil did. Jerry gave correct answers to 80 percent of the 50 
Items. How many Items did Philanswercorrectly? 
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(The student Is asked to Identify 
the parts of the problem.) 
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the diagram. Correct answers are given 
In Italics above each component «) 
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pioblem, of coui*se, he or she will need specific infoimation about the paits of the model and more 
detailed mapping. The abstract model is then developed more completely profile by profile. 

An important feature of SPS's instruction is the explanation of how two or more profiles fit 
together within a single problem. This is done abstractly, as described above, using the terms Given, 
Paitial Answer, and Final Answer. U is also done more concretely by focusing on the profiles, their 
constituent parts, and the way these parts are related. SPS takes the student through the planning and 
linking of profiles for several examples. With each example SPS points out the overall profile and 
displays the appropriate diagram. Two paits of the diagram contain question marks, indicating that they 
are both unknown. One of the unknown parts can be found by looking at a second piofiH *hat is 
also present in the problem. SPS displays a second diagram, linking it to the first (see Figure !> . SPS 
emphasizes that the solution found with the second diagr.?m will have a place in the first. Thus, the 
two piofiles are linked through specific components of the diagrams. 

One strength of using icons to represent the semantic profiles is that they can be easily and clearly 
linked to each other. These connections are important in solving multi-siep problems. Students need 
to visualize how the profiles can be joined together to form a complex problem. With the icons SPS 
can show them directly. 

Evaluation 

Two of the instructional goals described above are evaluated directly in the current implementation 
of SPS. A third form of evaluation is under development and will be incorporated into the system this 
year. The two that are now in use evaluate whether the student is able to recognize the primary profile 
in a multi-step problem and whether the student is able to complete an abstract model of a problem. 
The third task involves linking the icons and is described at the end of this document under System 
Exiensioits. 

Students identify main and secondary profiles in several exercises. The first of these exercises 
involves reading a multi-step problem and selecting one of two choices for the main situation. As with 
the constraint mapping instruction, SPS develops the concept first with only two of the profiles (Change 
and Group) and allows the student to master them. Two others are then studied (Compare and Restate) 
with accompanying exercises. After the full set of profiles has been reviewed, SPS presents a series of 
problems involving a random mixture of all five. 

After the student has become proficient in finding the primary profile, SPS assigns tasks involving 
the identification of both the main and the secondary situations. In this case the student gives two 
responses by making a choice from a menu of primary situations and a choice from a menu of secondary 
situations. Figure 6 illustrates this exercise. 

SPS also evaluates the student's ability to map multi-step problems abstiactly. Rather than having 
students move text from the problem into the appropriate diagram, SPS asks the student to locale the 
words Given, Partial Answer, and Final Answer within it. As before, the student is given the opportunity 
to change a response if it is incorrect. After two failing attempts to make the abstract map, SPS shows 
the student the correct mapping, as shown in Figuie 7. 



ImplemenUUion 

Instruction 

The last segmera of SPS instruction addresses the selection of an appropriate arithmetic operation 
for solving a stor) problem. This is the first time arithmetic computation is mentioned. At this point 
SPS cautions that relying only on key words such as "have left" or "altogether" in choosing an 
appropriate arithmetic operation often results in errors. It stresses instead that choice of operation 
is dependent upon profile identification and upon awareness of which part of the profile model is 
missing. This is an important aspect of schema-based instruction: The use of key words ana set 
equations is aoi a satisfactory method for solving problems. Unfortunately, it is sufficient for many 
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simple one-siep problems, and a large number of students appaienily have developed key-woid strategies 
(c.f., Mai shall, 1982; Sowder, 1987). 

The following example illustrates the instructional methods employed in SPS. Consider this Change 
problem: 

Jim added 20 more baseball cards lo his colkaioiu He then had 
68 cards aliogeUier. How many cards did he have lo begin with? 

SPS explains that, although this situation clearly reflects the addition of the new cards to the existing 
ones, the arithmetic operation needed to solve the problem as stated is not addition. SPS points out 
that in this case the initial amount is unknown. To find it the student needs to subtract the amount 
of change from the total rather than add the two. in this problem SPS encourages the student to 
identify the profile (Change), to use constraint knowledge and feature recognition knowledge to develop 
the appropriate diagram (either mentally or on paper), and tq determine where the unknown occurs 
within the profile. 

Students using SPS already have strong knowledge of arithmetic operations - including algorithms, 
usages, and requirements. SPS augments the student's operational knowledge and helps create schemas 
that incorporate the existing knowledge with new knowledge about semantic profiles. 

SPS implementation instruction consists of a brief review of the important parts of each profile, 
examples of profile-specific problems with each part missing, and the appropriate operation to be used 
in each example. Diagrams are used to show the student how to determine which part is missing and 
how to consider which operation to i-se in finding it. This section of instruction refers directly to the 
recognition, constraint mapping, and pla nning components of SPS and links them with the implementation 
component. 

Evalualion 

An exercise follows the computation discussion about each profile. In each exe.'cise SPS presents 
a problem and asks the student to select an arithmetic expression that will solve it. The arithmetic 
expression does not require the student to make a computation. The expression has the form "Subtract 
250 from 375" or "add 5 and 8". Following instruction and exercises for each profile is a task in which 
problems representing all five profiles are randomly presented. Figure 8 shows this task. 

The Synthesis 

Two assessments are made at the end of instruction, an on-line test and a traditional paper-and- 
pencil evaluation. The on-line task requires the student to recognize, diagram, and plan a solution strategy 
for problems which contain various combinations of the five profiles. This exercise tests whether all of 
the knowledge is successfully linked together. It also gives students practice in using the components 
simultaneously. The student makes two responses in this task. The first response is the choice of the 
appropriate icon (feature recognition). The second response is to indicate the unknown in the selected 
icon. Knowledge of constraint mapping and planning are required here but are not specifically and 
separately cued. The student must make the mental mapping (either specific or abstract) to locate the 
overall unknown of the problem. 

The paper-and-pencil evaluation consists of a set of multi-step problems. For the first time 
students are asked to solve the problems, carrying out the operations and answering the questions posed 
in the problems. They are also asked to indicate which of the profiles are present in each problem. 

The two forms of evaluation provide data about which parts of the schemas are well learned. 
In aggregation these data provide information about the efficacy of the system and give clues about 
where instruction might be expanded, compressed, or otherwise improved. 
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Figure 8 

An Example of an Implementaiion Exercise 



INSTRUCTIONS RMd th« |HaU«n lislovv tiiU th«h louli «i 
tha po»Mb(« it*pft yew might i«k« to kolv« ih« pii»lil«m 
Ulit tha ona that will loiva th« problem cerrMtly. Mev« 
tho arrow to your lolaciion %n4 click th« meut« button 



Dan Robinson recently drove 21 S miles from 
San Diego to Santa Baibara to see his parents. 
When he arrived at his patents*, he noticed 
that the odometer of his car registered 
45631 miles. What was the odometer reading 
before he made the trip? 



POSSIBLE STEPS: 



Multiplw 2lSby2 
AJd21Sand4S.SI1 
Oivida4S.S3lby2lS 
Subti act 21S from 4S.S31 



No. thi» un't th« corrtct choict In thit CHANGE probl«m. 
0«n had 4Si.SI1 rnilti on hn c«r «tt«r h« drev« to S«nt« 
l«rbor« Thift u th« END AMOUNT. H« h«d 21S mii«* fowor 
than this bof or« ha drovt to S«nt« |«rb«r« 21S it th« 
CHANGE AMOUNT. V ou trt suppoiod to find tho ICGlNNlNG 
AMOUNT: how miny mii«» D«n h«d on hii c«r b«f or« h« 
drovt to Stntt |«rb«r« Th« cort«ct w«y to do thi» !» to 
Mbtrtct. not «dd. 21S from 4SJI1. which ii th« i«it chojc« 

Click tn th« OKAY bOM to |o on. 



Dan Robinson recently drove 215 miles from 
San Diego to Santa Barbara to see his parents 
When he arrived at his parents', he noticed 
that the odometer of his cat registered 
456B1 miles. What was the odometer reading 
befoie he made the trip? 



POSSIBLE STEPS: 



Mul tiply 2lSb> 2 
Subtract 21S from 4S.SI1 



(The, student mekee a selection from (The student's response Is Inverted, 
e menu of responses.) Feedbsck Is sltuatlon-speclf 1c. ) 
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SYSTEM DETAILS 



EQUipmfnL SPS was developed in Lisp on Xeiox 1186 Al work stations with 40 megabytes of memory. 
Each work station is equipped with a Xerox 6085 series keyboaid. floppy drive, 19-inch display, and a 
three-button optical mouse. 

The Instructional/Experimental Setting, In field tests and in experimental laboratory studies students 
worked independently. Typically, four students were present at the same time, each interacting with SPS 
at a stand-alone work station. Students participated in 5-8 instructional sessions, with most sessions lasting 
minutes. 

Student Responses. Students interact with SPS by means of the optical mouse. A special tutorial 
instructs them in the use cf the mouse prior to the onset of SPS instruction about the profiles. Students 
move into the SPS instruction only when they have mastered use of the mouse. The mouse tutorial 
shows the students how to move the cursor on the screen by moving the mouse, and it gives students 
practice in making menu selections and in moving items around on the screen. At the end of the 
tutorial students complete a short exercise using the skills they had just learned. When students appear 
to have trouble manipulating objects on the screen, the system provides them with more practice. 

In SPS students respond to items in one of two ways. The first way allows students to make a 
menu selection. Typically the menu contains two to five items, and the student need only move the 
cursor to the item selected in the menu and press the left or middle mouse button. See Figures 1, 4b. 
and 6 as examples. 

The second response mode involves repositioning items on the screen. For this response the 
student aligns the cursor and the item to be moved (usually text) and presses the left button. The 
selected item changes to inverse print on the screen and a dotted box having the shape and size of 
the selected item appears. When the cursor is moved, the dotted box moves with it. The student 
positions the dotted box in the desired new location and again presses the mouse button. The inverted 
region returns to normal, the dotted box disappears, the selected item is a>pied onto the new location. 
Figures 2, 4b, and 7 illustrate this response type. 

Screen Design of Instritction. SPS presents much of its instruction thiough a cential 6 1/2" x 9" 
window on the 11" x 15" screen. Attached to the window is a menu with the options "Next Page" 
and "Last Page", allowing students to proceed at their own pace, moving to the next page or returning 
to previously displayed instruction if desired. Other windows, up to three at once, appear at various 
times during instruction. These windows are of differing sizes and locations. They allow simultaneous 
presentation of an example problem, a aescription of its structure, and a graphical illustration. Control 
of the display passes from window to window. Some of them remain on the screen as others change 
or vanish. 

Exercise Design Exercises drill the particular features of problem solving covered by SPS instruction. 
Many of these concepts are intennediate problem-solving steps that may be rarely observed in ordinary 
instruction. SPS contains thirty different exercises. The individual student may encounter all of them 
or a subset, depending upon the time limitations for instruction. Typically, whenever a new concept is 
introduced through instruction, it is followed oy a simple exercise that further demonstrates the concept 
and allows the student to use it directly. 

The exercises are designed to allow explicit evaluation of the four components of schema knowledge 
as described above. Some of them have only a single response from one menu, some contain multiple 
menus and hence multiple responses, and still others necessiitate making selections and moving elements 
around on the screen. When the response is a menu selection, SPS evaluates the student's response and 
makes appropriate feedback (as described below). The student has only one opportunity to respond to 
an item and SPS evaluates that response as soon as the menu selection is made. 

Evaluation is delayed in tasks requiring the student to move items. This design is most often 
used in the diagramming exercises. Such tasks generally have several items to be moved. SPS gives 
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the student several opportunities to lespond and delays evaluation of the response until ihc student 
signals completion by buttoning in a control menu window. SPS assesses the accuracy of each item 
that has been positioned in a diagram and allows the student a second allenipl if any of the items is 
incorrectly located. The student first buttons on the "FIX" option in the control menu window, clearing 
the screen of the previous response. The student then repositions the items as desired. 0»>-e the 
s.udcni is satisfied with the new response, he or she buttons on the "OKAY" option. SPS evalu«ves the 
response and gives feedback. To continue the student buttons on "GO ON" in the control menu 
win Jow. 

Hem BankS^ SPS requires three item banks: situations, one-step problems, and multi-step problems. 
Each bank contains a large number of items, and each item has a set of properties associated with it. 
SPS uses these properties to assess correct responses to the various exercises and to provide .cl*^vani 
feedback to students. Each item may be used in a variety of exercises, and there is no single correct 
answer associated with each one. Depending upon the exercise, the appropriate answer might be the 
identification of the underlying profile(s). the correct mapping of the specific elements of the item, an 
abstract mapping, or an arithmetic expression. 

SPS uses problems and situations that were created for it and that conform to the following 
criteria: Traditional key words and phrases are avoided whenever possible, themes and story lines aie 
appropriate for young adults. Items are worded for clear mapping into the profile diagrams, and 
numbers used in the problems are simple. 

Feedback. SPS provides feedback to students who answer an exercise question incorrectly. The nature 
of the feedback depends upon the particular exercise, in the feature recognition tasks, SPS's response 
to the student depends upon how the student is doing in the particular exercise. If the student makes 
two errors in identifying a particular profile. SPS gives supplemental review about that profile. If the 
student has erred on three consecutive items, SPS provides a general review of all profiles. If the 
student is generally doing well but makes an occasional eiror. SPS gives a shoit message indicating why 
the student's answer is incorrect. 

Feedback on the mapping tasks is brief. When a student first ens on an item, SPS indicates 
that the response is incorrect and asks the student to ti^ again. After a second error on the item, 
SPS simply shows the student the correct mapping. The student's own attempt remains on the screen 
together with the correct response so that the student can see how his or her answer differs from the 
correct assignment. 

The planning exercises demand a different type of feedback. When ?he student selects an incoriect 
primary or secondary profile, SPS gives problem-specific feedback, indicating why the student's selection 
is in error and identifying specific characteristics of the problem to which the student should attend. 
The implementation exercises also incorporate problem specific feedback. 

Each instructional session ends with a task for which no feedback is given. Sessions are typically 
50 minutes in duration (similar to a class period in high school or university). SPS monitors the time 
and ends the instructional session at an appropiiate juncture, usually at the conclusion of a set of 
instruction and related exercises. Before the student leaves the work station, he or she ic asked to 
respond to an end-of -session task which functions as a daily quiz. In early sessions, the task involves 
matching the five profile names to five story situations, in later sessions, the student identifies the 
location of the unknown in the problem. On both of these tasks, the student makes his or her 
responses to a small number of items and then exits the program. 

Record Keeping t SPS keeps a continuous log of each student's activity, it records the date, the time 
required for each exercise, the specific problems used in the exercise, the student's responses to each 
problem, and SPS's rejoinder. During each exercise SPS refers lo the log and to the student's current 
responses to develop a model of how the student is performing. At various points in the exercises. SPS 
will stop the student and will provide additional instruction if the student appeais to need it. This 
supplement may Uke the form of a quick review or may be an extensive remediation. 
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System Implementation 



SPS has been used in a four-week remedial course for community college students eniolled m 
basic mathematics or beginning algebra courses. The course met twice a week for a total of eight class 
sessions. Approximately twenty-five students completed the program of instruction This course seived 
as a field test and led to several important system modifications. 

SPS has also been the basis of laboratory experiments in which college freshmen paiticipated. 
These students attended five sessions and were individually interviewed following each session. Some or 
them also participated in a follow-up study two to three months after the original study. Data from 
these implenr?entations are currently being analyzed and will be reported in a separate report. Initial 
indications are that students can easily learn the semantic profiles, they can cany out the constiaiiu 
mapping and planning tasks, and they find the icons useful. 

System Extensions 

Once the students have developed semantic schemas for story problems it is desirable to have an 
environment in which they can instantiate them and in which SPS can monitor the usage of them. To 
this end we have developed a problem environment (PE) in which the student has the capability of 
selecting icons to represent parts of a multi-step problem and of manipulating them to model the 
problem.^ Figure 9 illustrates the environment. 

The problem environment is student-controlled. The student can select which icons to use, can 
link and unlink them, can enlarge and map the various parts of them, and can ask for confirmation 
or help from SPS at any point. SPS will not direct the order in which any of the problem-solving 
steps are carried out by the student. SPS provides advice when asked and will test for the student 
whether a representation leads to a successful solution of the problem. 



Wc «M;kno>Arluii;c J P Mur^hal) for hi» programming a^buirac in liuildmg ihc probk;n> unvironmciit 



Figure 9 
The Problem Environment 
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APPENDIX A 



Prior to the development of SPS carried out experiments to evaluate specific design features 
for SPS. Described here is one experimenial study of the effects of sequential versus all-at-once 
presentation of the situations. ^ 

The Experimental Ougstion: The issue is whether students will be moie successful in learning 
^ when each situation is described individually and in detail, one at a time, or whether students will 

be more successful in learning when all five situations are introduced broadly and then described in 
relation to each other. The former should cause greater depth of feature recognition inforr/iation but 
^ perhaps be weuker in constraint (and discrimination) knowledge. The latter should build a knowledge 

base that allows easy discrimination among the situations but may l«twK adequate feature knowledge. 

Procedure: 126 San Diego State University students paaicipated in the study. Half of them 
received Sequential Instruction (with each type of situation developed fully before the presentation of 
another one) and the remaining half received Parallel Instruction (with all types presented at once and 
discussed together). Each student worked through a paper>and-pencil exercise booklet. At the 
conclusion of the experiment, the students were asked to sort 20 problems according to the situations 
they had just studied. The sorting task was used to evaluate the students* understanding and 
recognition of the five situations. 

EfiSUllSl Cluster analyses of the sorting task are given in Figures A.I and A.2. All students 
learned something about the situations, and they were able to sort more than half of tKe problems 
correctly. The studenU in the Parallel group performed better on this task. They were more 
successful in forming appropriate clusters of the problems, and their clusters were mo'-e tightly linked 
(as can be seen by the shape of the clusters in the figures). Moreover, the Sequential Group had 
difficulty in distinguishing between Compare and Restate. The largest cluster formed by this group 
contained problems of both types. 

Both groups had difficulty in distinguishing between certain Change and Group items. There was 
also some confusion in both groups among some of the Restate and Compare items, although this was 
much more prominent in the Sequential Group. 
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Figure A.i 

Results of the Sorting Task: Sequential Group 
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Figure A.2 

Results of the Sorting Task: Parallel Group 




ERIC 



Group 

A2 29 













ONR Distribution List - S. Marshall - 




Dr. Bath Ada 1 son 


Dr. Lee Roy Beach 


Dr. Susan Carey 


Dr. Jere Confrey 


Dapartnmnt of Computer Science 


Dept. of Psychology (NI*25) 


Dept of Cognitive & Neural Science 


Come 1 1 Uni versi ty 


TuftB University 


University of Washington 


MIT 


Dept . of Education 


Medford, MA 02155 


Seattle, WA 98195 


Cambridge, MA 02139 


Room 490 Roberts 








Ithaca, NY 14853 


Air Fo^c* Human Resources Lab 


Dr. Isaac Bejar 


Dr. Pat Carpenter 




AFHRL/MPO 


Mail Stop: 10-R 


Carnegie-Mellon University 


Dr. Wi 11 iam Crano 


Brooks* AFB, TX 78235 


Educat i one 1 Test i ng Serv i ce 


Department of Psychology 


Department of Psychology 




Rosedale Road 


Pittsburgh, PA 15213 


Texas A&M University 


AFOSR, Life Sciences Directorate 


Princeton, NJ 08541 




College Station. TX 77843 


Boiling Air Force Ba^e 




Dr , John B. Carrol 1 




Washington, DC 20332 


Dr. John Black 


40^ E 11 i ot t Rd . . North 


Dr . Cary Czi Chon 




Teachers College, Box 8 


Chapel Hill, NC 27514 


Intelligent Instructional System 


Dr. Robert Ah^ers 


Col umbia UniverSi ty 




Texas Instruments AI Lab 


Codo N7 1 1 


525 West 120th Street 


CDR Robert Carter 


P.O. Box 660246 


Human Factors Laboratory 


New York. NY 10027 


Of f i ce of Ch i ef of Neva 1 Opera c i ons 


Dallas, TX 75266 


Naval Training Systems Cer.ter 




0P*'933D4 




Orlando, FL 32813 


Dr . R . Darrel 1 8ock 


Washington. DC 20350-2000 


Brian Dal Iman 




University of Chicago 




Training Technology Branch 


Dr. John R. Anderson 


NORC 


Dr. Davida Charney 


3400 TCHTW/TTGXC 


Department of Psychology 


6030 South Ellis 


Engl i sh Department 


Lowry AF8. CO 80230-5000 


Carnegie-Mttl Ion University 


Chicago, IL 60637 


Penn State University 




SchOnley Park 




University Park. PA 16802 


Dr. Robert B. Davis 


Pittsburgh, PA 15213 


Dr . Jeff Bonar 




Curriculum Laboratory (Education 




Learning R&D Can t e r 


Dr. MiChelene Chi 


University of Illinois 


Dr. Nancy S. Anderson 


University of Pittsburgh 


Learning R&D Center 


Urbana, IL 61801 


Departmant of Psychology 


Pittsburgh, PA 15260 


Univarsity of Pi ttsburgh 




Univarsity of Maryland 




3939 0 'Hara St reet 


Dr. Sharon Derry 


Col lege Park, MD 20742 


Or . J . C . Boudraaux 


Pi ttsburgh, PA 15260 


Florida State University 




Ctr for Manufacturing Eng 




Department of Psychology 


Technical Director, ARI 


Nat ional Bureau of Standards 


Dr . Willi am C 1 anc v 


Tal lahassee. FL 32306 


5001 EisanhOMsr Avenue 


Gai thersburg, MD 2089S 


Institute for Resea. ''h on Learning 




Alexandria, VA 22333 




3333 Co^':>te Hill Road 


Dr. J. Stuart Donn 




Dr. Robert Braaux 


Palo A1 to, CA 94304 


Faculty of Education 


Dr. Patricia Baggett 


Code 7o 




University of British Columbia 


School of Education 


Naval Training Systems Ctr 


Asst Chief of Staff for Research 


2125 Mffin Mai 1 


610 E. University 9m 1302D 


Orlando, FL 32B13-7100 


Deve 1 opment , Test . and Eva 1 uat i on 


Vancouver. BC CANADA V6T 1Z5 


University of Mict jan 




N.iva 1 Educat i on and 




Ann Arbor, MI 48109-1259 


Dr . lohn S . Brown 


Tra i n i ng Command ( N'5 ) 


Defense Technical Information Ct 




XEROX Palo Alto Research Ctr 


NAS Pensacola, FL 32508 


Cameron Station, Bidg 5 


Dr. Eva L. Baker 


3333 Coyote Road 




Alexandria. VA 22314 


UCLA 


Palo A1 to. CA 94304 


Dr. Paul Cobb 


Attn: TC 


Ctr for the Study of Evaluation 




Purdue Un i vers i t y 


( 12 Copies) 


145 Moore Ha 11 


Dr. John T. Bruer 


Educat i on Bu i 1 d i ng 




University of California 


James S. McDonnell Foundation 


W. Lafayette , IN 47907 


Dr. Richard Duran 


Los Angeles. CA 90024 


Suite 1610 




Graduate School of Education 




1034 ^outh Brentwood Blvd. 


Dr. A1 Ian M. Col 1 ins 


University of California 


Dr. Wi 1 1 iam M. Bart 


St . Louis, MO 631 17 


Bolt Beranek & Newman. Inc. 


Santa Barbara. CA 93106 


University of Minnesota 




10 Moul ton Street 




Dept. of Educ . Prychology 


Dr. Joanne Capper, Director 


Cambridge. MA 02238 


Dr . Susan Embretson 


330 Burton Hal 1 


Ctr for Research into Practice 




Uni versi ty of Kansas 


178 Pi 1 1 sbury Dr. , S. E . 


1/ lo \»unnt5uii(.ui mvc.. n.w. 


r\r- ^fMnlAu Cn\ luAr Cnria 999 
ut, dianicy \»ui lycr, v^ooe ^ £ ^ 


Psycho 1 ogy Department 


Minneapolis. MN 55455 


Washington . DC 20009 


Of f i ce of Neva 1 Techno 1 ogy 


426 Fraser 






800 N. Ouincy Street 


Lawrence. KS 66045 






Arlington, VA 22217-5000 




30 

o 






31 


ERIC 









mc Fact tlty-AcquUlt Ions 
4350 East-«»st Hwy. 
Suit* 1100 

••thasda, MD 20614-4475 

Or. Saatrlca J. Farr 
Amy Rasaarch Xnstituta 
MRX-IC 

6001 Elsanhowar Avanua 
Alaxandrla, VA 22333 

Dr. Marshall J. Farr 
Conaul tant 

Cegnitiva a Instructional 

Sclancss 
2820 North Vsmon Strsst 
Arlington, VA 22207 

Or. P-A. Fsdsrico 

Coda 51 

MWIDC 

San Dlago* CA 92152-6800 

Or. Paul Fsltovlch 

Southarn Illinois Unlvarslty 

School of Madlclna 

Modlcal Education Dapartmtnt 

^•0. Box 3026 

Sprlngflald, IL 62708 

Mr. waiiaca Faurzalg 
educational Tachnology 
Molt BaranaH A Nawman 

10 Moulton St. 
Caabrldga* MA 02238 

Or. Garhard Fischar 
Llablggassa 5/ 3 
A 1010 Vlanna 
AUSTRIA 

Or. Garhard Fischar 
Unlvarslty of Colorado 
Oapt of Comput ar Sdanca 
Bouldar, CO 80309 

Or. Lirda Flowar 
Carnagla^Manon Unlvarslty 
Oapartmant of English 
Pittsburgh, PA 15213 

Dr. Barbara A. Fox 

Unlvarslty of Colorsdo 
Oapartmant of Linguistics 
Bouldar. CO 80309 



ERLC 



Or. Carl H. FradarlUsan 
Oapt . of Edtcat lonal Psych . 
McGin University 
3700 McTavlf^h Straat 
Montreal , Quabac 
CANAOA H3A 1Y2 

Or. John R. FradarlKsan 
BBN Laboratoriss 
10 Moulton Straat 
Cambridge, MA 02238 

Or. Norman Frederlksen 
Educational Testing Service 
(05-R) 

Princeton. NJ 08541 

Or. Michael Friendly 
Psychology Oepartment 
York University 
Toronto ONT 
CANAOA M3J 1P3 

Or. Robert M. Gagna 
1456 Mitchel 1 Avenue 
TallahaiAsee. FL 32303 

Or. oedre Gentner 

University of 1 11 Inols 
Oepartment of Psychology 
603 E. Oanlel St. 
Champaign, IL 61820 

Psychology Oepartment 
George Mason University 
4400 University Orlve 
Fairfax, VA 72030 

Or. Robert 0. Gibbons 

IL State Psychiatric inst. 

Rm 529W 

1601 W. Taylor Street 
Ch1r:^go, IL 60612 

Or. C. Lee G1 les 
AFOSR/NE, Bidg. 410 
Bol 1 Ing AFB 
Washington. OC 20332 

Or. Herbert Ginsburg 
Box 184 

Teachers Col 1 ege 

Columbia University 
525 West 121st Street 
New York, NY 10027 



Or. Robert Glaser 
LROC 

University of Pittsburgh 
3939 0 Hara Street 
Pittsburgh. PA 15260 

Or. Arthur M. Glsnberg 
University of Wisconsin 
W. J. Brogden Psych. Bidg. 
1202 W. Johnson Street 
Madison. WI 53706 

Or. Marvin 0. Glock 
101 homestead Terrace 
Ithaca. NY 14856 

Or. Sam jiucksberg 
C^partment of Psychology 
Princeton University 
Princeton. NJ 03540 

Or. Susan R. Goldman 
Dept. of Education 
University of California 
Santa Barbara. CA 93106 

Or. Sherrle Gott 
AFHRL/MOMJ 

Brooks AFB. TX 78235''560l 

Or. T. Gov1ndar«J 

GA Institute of Tachnology 

Schoo 1 of Indust rial 

and Systems Engineer 1 ng 
Atlanta. GA 30332-0205 

Or. Wayne Gray 
Army Research Institute 
5001 Elsenhower Avenue 
Alexandria, VA 22333 

Or. Bert Green 
jOhns Hopkins University 
Oepartment of Psycho 1 ogy 
Charles & 34th Street 
Baltimore. MO 212l8 



32 



Or. James G. Greeno 
School of Education 
Stanford University 

Room 31 1 

Stanford, CA 94305 

Prof. Edward Haertel 

School of Education 
Stanford University 
Stanford. CA 94305 

Or. Henry M. Halff 
Halff Resources. Inc. 
49l8 33rd Road. North 
Arlington. VA 22207 

Or. Ronald K. Hambleton 
University of Massachusetts 
Laboratory of Psychometric 
and Evaluative Research 

H11 Is South. Room 152 
Amherst. MA 01003 

Or. Ray Hannapel 
Scientific and Engineering 
Personnel and Education 
National Science Foundation 
Washington. OC 20550 

Or. John R. Hayes 
Carneg'.e-Mel 1 on University 
Oepartment of Psychology 
Schenley Park 

P1ttsbu«"gh. PA 15213 

Or. Barbara Hayes-Roth 
Knowledge Systems Lab 
Stanford University 
701 welch Road 
Palo Alto. CA 94304 

Or. Mel issa Hoi land 
Army Research Institute 

for the Behavioral and 

Social Sciences 
5001 Elsenhower Avenue 
Alexandria. VA 22333 

Or. Keith Holy oak 
Oepartment of Psychology 
University of California 
Los Angeles. CA 90024 



Ms. JuHa S. Hough 
Lawr«nc« Eribaum Associates 
110 W. Harvay Street 
Philadelphia, PA i9i44 

Or. Lloyd Humphreys 
University of 111 InolS 
Department of Psychology 
603 East Daniel Street 
Champaign. IL 61620 

Or, Ed Hutchlns 
Intelligent Systems Group 
Inst, for Cognitive Science 
UCSO 

La Jol la. CA 92093 

Or. Huynh Huynh 
College of Education 
Univ. of South Carolina 
Columbia. SC 29206 

Or. Al ice M. Isen 
Oepartment of Psychology 
University of Maryland 
Catonsvllle. MO 21228 

Or. Jan^t JacKSOn 
R1 jKsunI versi tel t Gronlngen 
6lolog1sch CentrufT. Vleugel 0 
Kerklaan 3D. 9751 NN Haren 
The NETHERLANOS 

Or. Robert Jannarone 
Elec. and Computer Eng. Oept . 
University of South Carolina 
Columbia. sC 29206 

Or. Claude Janvier 
Unlverslte' du Quebec 
a Montreal 

P.O. Box 8888. sucC: A" 
Montreal. Ouebet H3C 3P8 
CANAOA 

Or. Robin Jeffries 
Hewlett-Packard Laboratories 
3L 

P.O. 8ox 10490 

Palo Alto. C^ 94303-0971 

Or. Oouglas H. Jones 
Thatcher Jones Associates 
P.O. Box 6640 
10 Trafalgar Court 
Lawrencevl 1 1e. NJ 06648 



Or. Marcel Just 
Carnegie-Mellon University 
Oepartment of Psychology 
Schen 1 ey Park 
Pittsburgh. PA 15213 

pr . Ruth Kanf er 
University of Minnesota 
Oepar tment of Psycho 1 ogy 
Ell lott Hal 1 
75 E . R1 ver Road 
Minneapol Is. MN 55455 

Or. Milton S. Katz 
Eur Of ean Sc 1 ence Coord i nat i on 
Off Ice 

U.S. Army Research Institute 
Box 65 

FPO New VorK 09510-1500 

Or. Frank Kel 1 
Oepartment of Psychology 
228 Uris Hal 1 
Corne P Uni vers 1 1 y 
Ithaca. NV 14850 

Or. Wendy Kel 1 ogg 

IBM T. J. Watson Research Ctr 

P.O. Box 704 

Vorktown Heights. NV 10598 

Or . Oenn is K i b 1 er 
University of California 
Oepartment of Information 

and Computer Science 
Irvine. CA 92717 

Or. Oavid Kleras 

Tech . Commun 1 cat 1 on Program 

TIDAL Bldg. 

2360 Bonlsteel Blvd. 

University of Michigan 

Ann Arbor, MI 48l09-2l0tt 

Or . Kenneth Kot ovsky 
Community Col lege of 

A 1 1 egheny Co . 
808 Ridge Avenue 
Pittsburgh, PA 15212 

Or. Pat Langley 
University of California 
Oepartment of I nf ormat i on 

and Computer Science 
Irvine. CA 92717 



Or . Jill Lark i n 
CAPT Tom Junes Carneg1e-Me 1] on University 

OnR Code 1210 Department of Psychology 

800 N. Ouincy Street Pittsburgh, PA I52l3 

Arlington, VA 22217-5000 



Or. Jean Lave 
Institute for Research 

on Learning 
3333 Coyote Hi 1 1 Road 
Palo Alto. CA 92304 

Or. Robert W. Lawler 

Matthews 118 

Purdue University 

West Lafayette, IN 47907 

Or. Alan M. Lesgold 
Learning R&O Center 
University of Pittsburgh 
Pittsburgh, PA 15260 

Or . J ohn Lev i ne 
Learning R&O Center 
University of Pittsburgh 
Pittsburgh. PA 15260 

Or. Michael Levine 
Educat i onal Psychol ogy 
210 Education Bldg. 
University of Illinois 
Champaign. IL 61801 

Or . CI ay ton Lewi s 
University of Colorado 
Oept of Computer Sc i ence 
Campus Box 430 
6oulder . CO 30309 

Matthew Lewis 

Rand Corporation 

P.O. 90K 2136 ^^^^ 

Santa Monica, CA 90406-2 138 

L 1 brary 

Naval Training Systems Ctr 
Orlando. FL 326l3 

L Ibrary 

Naval war Col lege 
Newport , RI 02940 

Science and Technology Oiv. 
L i brary of Congress 
Washington, OC 20540 

Or . Marc i a C . Linn 

Graduate Schoc i of Educat i on 

EMST 

To I man Ha 1 I 

Universi''wy of California 
Berkelev. CA 94720 

Dr Robert L . Linn 
Campus Box 249 
Um vers i t y of Co 1 or ado 
Boulder, CO 80309-0249 



Dr. Richard E. Mayer 
Oepartment of Psychology 
University of California 
Santa Barbara. CA 93106 

Or. James R. McBrlde 

The Psychological Corporatlor 

1250 Sixth Avenue 

San Olego. CA 92101 

Or . Joseph C . McLach 1 an 
Code 52 

Navy Personnel R&O Center 
San Oiego. CA 92152-6800 

Or. James McMichael 
Technical Oi rector 
Navy Personnel R&o Center 
San Olego, CA 92152-6800 

Or. Barbara Means 
SRI Internet lonal 
333 RavenSwood Avenue 
Menio Park. CA 94025 

Or . Ooug 1 as L . Medi n 
Oepartment of Psychology 
University of Illinois 
603 E. Oaniel Street 
Champaign. IL 61620 

Or . George A . Miller 
Oept . of Psychology 
Green Ha 1 1 

Pr i ncet on Un i vers i t y 
Princeton, NJ 08540 

Or. Andrew R. Molnar 
Appi 1 cat 1 ons of Advanced 

Techno 1 ogy 
Science and Engr . Education 
National Science Foundation 
Washington. OC 20550 

Or. William Montague 

NPROC Code 13 

San Oiego. CA 92152-6800 

Or. Randy Mumaw 

Training Research Oivlsion 

HumRRO 

1 100 S, Washington 
Alexandria, VA 22314 

Or . A 1 1 en Munro 
Behavioral Technology Labs 

use 

1845 S. Elena Ave.. 4th Floor 
Redondo Beach, CA 90277 



Dr. Richard E. Nisbatt 
Unlvarslty of Michigan 
Inatituta for Social Rasaarch 

Room 5261 

Ann Arbor, MI 48109 

Dr. Donald A. Norman 
C-015 

Inat. for Cognitive Science 
Unlvaralty of California 
La JoHa. CA 92093 

Daputy Technical Director 

NPRDC Code 01 A 

San Diego. CA 92152-6600 

D1 rector 

Training Laboratory 

NPRDC (Code 05) 

San Diego. CA 92152-6600 

D1 rector 

Manpower and Personnel Lab 

NPRDC (Code 06) 

San Diego. CA 92152-6600 

Director 

Human Factors & Organizational 
Systams Lab 

NPRDC (Cod*-* 07) 

S^n Diego. CA 92152-6600 

Library. NPRDC 
Code P201L 

San Diego. CA 92152-6600 

Technical Director 

Navy Personnel R&D Center 

San Diego. CA 92152-6600 

Commanding Officer. 

Naval Research Laboratory 
Code 2S27 

Washington. DC 20390 

Dr . Harold F . O'Nel 1 . Jr. 
School of Education - WPH 601 
Department of Educational 
Psychology & Technology 

use 

Los Angeles. CA 90069-0031 

Dr . Stel lan Dhl sson 
Learning R&D Center 
University of Pittsburgh 
^ Pittsburgh. PA 15260 



Office of Naval Research 
Code 1142 
600 N. Oulncy St . 
Arlington. VA 22217-5000 

Offica of Naval Research. 

Code 1142BI 

600 N. Oulncy Street 

Arlington. VA 22217-5000 



Office of Naval Research 
Code 1142CS 
600 N. Oulncy Street 
Arlington. VA 22217-5000 
(6 Copies) 

Office of Naval Research 
Code 1142PS 
600 N. Oulncy Street 
Arlington. VA 22217-5000 

Office of Naval Research 
Code 125 

600 N. Oulncy Street 
Arlington. VA 22217-5000 

Psychologist 

Office of Naval Research 
Branch Office. London 
aox 39 

FPD New York. NV 09510 

Special Assistant for Marine 

Corps Matters. 

DNR Code OOMC 
600 N. Oulncy St . 
Arlington. VA 22217-5000 

Dr. Judith Orasanu 
Basic Research Office 
Army Research Institute 
5001 Elsenhower Avenue 
Alexandria. VA 22333 

Military Assistant for Training 
and Person ne 1 Techno 1 ogy . 
OUSD (R & E) 
Room 3D129. The Pentagofi 
Washington. DC 20301-306C 

Dr. Ray S. Perez 

ARI (PERI-II) 

5C0 1 B i senhower Avenue 

Alexandria. VA 22333 



Dr. David N. Perkins 
Project Zero 
Harvard 

Graduate School of Education 
7 Applan Way 
Cambridge. MA 02136 

Dr. TJeerd Plomp 
Twent e Unl versi t y of Techno 1 
Department of Education 
P.D. Box 217 

7500 AE ENSCHEDE 

THE NETHERLANDS 

Dr. Martha Poison 
Department of Psychology 
U.flverslty of Colorado 
Boulder. CO 60309-0345 

Dr . Harry E . Popi e 
University of Pittsburgh 
Decl slon Systems Laboratory 
1360 Scalf e Hal i 
Pittsburgh. PA 15261 

Dr. Joseph Psotka 

ATTN: PERI-IC 

Army Research Institute 

5001 Elsenhower Ave. 

Alexandria. VA 22333-5600 

Dr. Lynne Reder 
Department of Psychology 
Carnegle-Me 1 1 on Un 1 vers 1 ty 
Schen 1 ey Park 
Pittsburgh. PA 15213 

Dr . St eve Reder 
Northwest Regional 

Educat lonal Laboratory 
400 Lindsay Bldg. 
710 S.W. Second Ave. 
Portland. OR 97204 

Dr. James A. Reggia 
University of Maryland 
Schoo 1 of Medl c 1 ne 
Department of Neurology 
22 South Greene Street 
Baltimore. MD 2)201 

Dr. J. Wesley Regian 
AFHRL/IDI 

Brooks aFB. TX 78235 



D-. Fred Relf 
Physl cs Department 
University of California 
Berkeley. CA 94720 

Dr. Lauren ReSnIck 
Learning R&D Center 
University of Pittsburgh 
3939 O'Hara Street 
Pittsburgh. PA 15213 

Dr. G1 Ibert Ricard 
Mai 1 Stop K02-14 
Grumman A1 rcraf t Systems 
Bethpage. NV 11767 

Dr. Linda G. Roberts 
Scl ence . Educat Ion. and 

Transportation Program 
Office of Technology Assessment 
Congress of the United States 
Washington, DC 20510 

Dr . W1 1 1 1am B. Rouse 
Search Technology. Inc. 
4725 Peachtree Corners Clrcl*- 
Suite 200 

Norcross . GA 30092 

Dr . Fumi ko Same J ima 
Deoartment of Psychology 
Unl versi ty of Tennessee 
310B Austin Peay Bldg 
Knoxvine, TN 37916-0900 

Dr. Robert Sasmor 
HODA DAMA-ARL 
Pentagon, Room 3E516 
Washington, DC 20310-0631 

Dr. Walter Schneider 
Learning R&D Center 
University of Pittsburgh 
3939 O'Hara Street 
Pittsburgh, PA 15260 

Dr. Alan H. Schoenfeld 
Unl vers 1 1 y of Ca 11 f orni a 
Department of Education 
Berkeley, CA 94720 

Dr. Janet W. Schofleld 
816 LRDC Bui Idlng 
University of Pittsburgh 
3939 O'Hara Street 
Pittsburgh. PA 15260 



r 



Dr. Judith W. Stga? 
OCRI 

555 Hmm J«rS«y Av«., NW 
Washington, DC 2020B 

Dr. Col 1««n M. Salfcrt 
Xnst. for Cognitive Science 
Mall Code C-015 
University of California 
La Jol la, CA 92093 

Dr. Lee S. ShulmaM 
School of Educat'ion 
507 Ceraa 

Stanford University 
Stanford. CA 94305-3064 

Dr. Randall Shumaker 
Naval Research Laboratory 
Code 5510 

4555 Overlook Avenue. S.W. 
Washington. DC 20375*5000 

Dr. Robert S. Slegler 
Carnegie-Mellon University 
Department of Psychology 
Schenley Park 

Pittsburgh. PA 15213 

Dr. Edward Silver 
LRDC 

University of Pittsburgh 
393g O'Hara Street 
Pittsburgh. PA 15260 

Robert L. Simpson. Jr. 

DARPA/XSTO 

1400 Wilson Blvd. 

Arlington, VA 22209-2306 

Dr. Zita M. Simutis 
Chief 

Technologies for Skill 

Acquisition and Retention 
ARX 

5001 Elsenhower Avenue 
Alexandria. VA 22333 

Dr. Derek Sleeman 

Computing Sclenc Department 

King's College 

Old Aberdeen AB9 2U6 

Scot land 

UNITED KXNGDOM 



Dr. Richard E. Snow 
School of Education 
Stanford University 
Stanford. CA 94305 

Dr . El 1 lot SolOMay 

Vale University 

Computer Science Department 

P.O. 6ox 2156 

NeM Haven. CT 06520 

Dr . Ri chard C . So^^ensen 
Navy Personnel R&D Cen t er 
San Diego. CA 92152-6600 

Dr . Paul Speckman 
University of Missouri 
Department of Statistics 
Columbia. MO 65^01 

Dr. Robert J. Sternberg 
Department of Psychology 
Vale University 
6ox 1 lA. Vale Stat ion 
NSM Haven. CT 06520 

Dr. Thomas Sticht 
Applied 6ehavioral and 

Cognl t i ve Scl ences . I nc. 
P.O. 6ox 6640 
San Diego. CA 92106 

Mr . 6rad Sympson 

Navy Personnel R&D Cent er 

Code-62 

San Diego. CA 92152-6600 

Dr. John Tangney 
AFOSR/NL. Bldg. 410 
Boiling AF6. DC 20332-6446 

Dr . K i kumi Tat suoka 
CERL 

2S2 Engineering Research 

Laboratory 
103 S. Mathews Avenue 
Urbana. IL 61601 

Dr. M. Martin Taylor 
DCIEM 
Box 2000 

Downsvi ew. Ontario 
CANADA M3M 369 



Dr. Perry W. Thorndke 

PMC Corporation 

Cent ra 1 Engi neeri ng Labs 

1205 Coleman Avenue. 6ox 560 

Santa Clara. CA 95052 

Dr. Martin A. Tolcott 
3001 veazey Terr., N.W. 
Apt. 1617 

Washington. DC 20006 

Dr. Douglas Towne 
6ehavioral Technology Labs 

use 

1645 S. Elena Ave. 
Redondo 6each. CA 90277 

Dr . Robert Tsutakawa 
University of Missouri 
Department of Statistics 
222 Math. Sciences 61dg. 
Columbia. MO 6521 1 

Dr. 21ta E. Tyer 
Department of Psychol ogy 
George Mason University 
4400 University Drive 
Fairfax. VA 22030 

Headquarters. 
U. S. Marine Corps 
Code MPI-20 
Washington. DC 20360 

Dr. Kurt Van Lehn 
Depart man t of Psychol ogy 
Carnegie-Mellon University 
Schen 1 ey Park 
Pittsburgh. PA 15213 

Dr. Jerry Vogt 

Navy Personnel R&D Center 

Code 51 

San Diego. CA 92152-6600 

Dr. Ming-Mei Wang 
Lindquist Center for 

Measurement 
Uni versi ty of Iowa 
Iowa City. XA b2242 

Dr. 6eth Warren 
66N La bora tor 1 es . I nc. 
10 Moul ton St reet 
Cambridge. MA 02236 



Dr . Kent E . Will iams 
Inst, for Simulation 

and Training 
University o*' Central Fla 
P.O. Box 25000 
Orlando. FL 32616-0544 

Dr . Hi Ida Wing 
NRC MH-176 

2101 Constitution Ave. 
Washington. DC 20416 

Ms. Marilyn Wingersky 
Educat i ona 1 Tc t i ng Serv i ce 
Princeton. NJ «f,41 

Dr. Robert A. Wisher 

U.S. Army Institute for the 

6ehavioral & Social Sciences 
5001 E isenhower Avenue 
Mlexandria. VA 22333-5600 

Dr. Martin F. Wiskoff 
Defense Manpower Data Center 
550 Camino El Estero. Suite 200 
Monterey. CA 93943-3231 

Mr. John H. Wolfe 

Navy Personnel R&D Center 

San Diego. CA 92152-6600 

Dr. George Wong 

6iostat istlcs Laboratory 

Memor i al S loan-Ket t er i ng 

Cancer Center 
1275 Vork Avenue 
New Vork. NV 10021 

Dr. Wallace Wulfeck. Ill 
Navy Personnel R&D Center 
Code 51 

San Diego. CA 92152-6600 

Dr. Masoud Vazdani 

Dept. of Computer Science 

University of Exeter 

Prince of Wales Road 

Exeter EX44PT 

ENGLAND 

Dr . Josepn L . Voung 

Nat ional Science Foundat ion 

Room 320 

1600 C Street . N.W. 
Washington, DC 20550 



37 



